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» , ' - • SECTION I 

. INTRODUCTION . 

The increasingly complex technology associated wflh the modern Navy 
fflaces an added burden on the Naval. Eductitron .ancf Training Conmand (NAVEDTRACOM) 
to insure 'that trainees po.ssess the skillsinecessary to perform in th^ fleet. 
It -is becoming increasingly apparent that many Navy re'zruits.and "A^' school 
students do !)ot possess the minimal level of required skills f^r successful 
scboal perfbrmance* An area of growing concern is proficiency in basic* niperi- 
c^l skills as a prerequisite for technical/training in'^&jjch fields as nuclear 
power, electricity, and electronics. Because of, these concefn^, a need exists 
. for a system to formally assess the extent of tjasic numerical skills deficiencies 
ift the recruit populatioh and to plan remedial instruction as early in the 
Navy training program as necessa^ry and feasible. 

BACKGROUND ' . • ^ ^ ^' ' 

r 

Most technical training programs^in the Navy retjuire a£ least some ^sic 
mastery of numerica-l skills,, yet instructor? often^cite lack of these sk^ills 
as a primary deficiency among students. Sachar and Baker (1981) reported 
that instructors in electronics -'A" schools expected^ students to enter the 
school with an array of math skills that should have been learned ejther in. 
high school or in preparatory Naval training programs* The instructors 
perceived that many students entering the. "A" schools lacked these ba^ic math 
skillSK*yet they spent a minimal amount of time reviewing and teaching, math 
in the "A" school classroom (1 to 5 percent of total training time), ^ 

Up to now, the Navy's only formal attempt to hfelp remedy the situationr 
has been the math remediation program that part of the Basic Electricity 
and Electronics (B^E) School. Students Scheduled to enter BESE take a 
diagnostic "math test. Students who have deficiencies in math are referred to *• 
individualized remedial math units but are not tested on these units (Sachar 
and Baker, 1981). • . r. ' ^ 

Several "A" schools are establishing therr own remedial math programs. 
One such program at th* Guided Missiles "A" School at 0am Neck, Virginia, 
employs a locally written screening test and N<is true tional modules, both of j 
which. match course objectives (Foster, 1981). Forty percent of entering 
students^ receive instruction from peers ^ (recently graduated students awaiting 
"C" School). Remedi^ti-on is given prior to the start of the formal course. 
.School personnel are convinced, by informal observation, that the program is S 
deducing atfrition^^ . , • ' , 

* < ■ ' 

In view of a pervasive need for training- lJi basic numerical skills in 
the Navy, the Training Analysis and Evaluation Group (TAEG) was tasked by the 
, Chie>1)f Naval Education and Trai ning (CNET) to develc^ a Navy numerical 
skills workbook and associated test.^ jhis work Vas completed in cooperation 
with the Chief of Naval Technical Training who contract^dj/ith Memphis State . -* 

VtCS G. Foster, Gtiided rtissiles School, Dam Neck,. VA, personal conmunication 
^Ct^ET Itr N-53 Of 20 Dec 1978 

/ 
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UniAtersity* Both the test and Workbook, Improving You.r Navy Numerical Skills , 
are contained in Bowman, JOfes, Kaiser, Kincaid, and McDdniel (1981) (hereafter^ 
referred to as TAE& Report |o» 96). The testn^as designed to assess basic 
skills involving numerical operations as well as the application of these 
basic skills to Navy-related probJems. The test was shown to be an effective 
tool to accurately identify rfecruits in,Apprentice Training and Academic 
Remedial Training who needed remedial math instruction* 
• ' ' * ( , 

At[ present, the Navy does not have a standard method for screening 
recruits who have deficiencies in basic math ^kills. The present^tudy used 
the Navy Numerical Skills Test'.to assess the need for math remediation in a 
group of. recruits about to .enter Apprentice Training and, in addition, explored 
the feasibility of using the Armed Services Vocatiorpl Aptitude Battery 
(ASVAB) test scores to predict math skills performance. 

PURPOSE ^ ' • -'^ 

The purprose of the study was to estimate the extent of basic numericn 
skills deficiencies -in a sample of recruits about to enter Apprentice Jraining. 
A Seconal, and equally irapo^rtant, purpose was to derrve a fortnula based on 
selected ASVAB test scores'^ which could boused to 'Predict numerical skills 
performance quickly and accurately. The formula could then be used to indicate* 
the need for further testing ?>r for placing recruits in remedial math instruc- 
tional programs • ^ 

ORGANIZATION OF THE REPORT • ' ' ^ 

In addition to this Introduction, the report contains two other sections. 
Section II describes the procedures used in the study and the results. There 
is a brief description of the Navy Numerical Skills Test and a report of the 
statistical techniques used to develop a method for screening students for 
numerical skills ^'remediation. Section III contains cooclusions and recommenda- 
tions which wjll assist the Navy in identifying recruits who need remedial 
math instr\jction» 



> 
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SECTIOfT II 
PROCEDURE AND R£SlHr^S 



The N^vy Nfltnerical Skills Test was administered in January and February 
1981 to 293 Tecruits--230 males and 63 females— at the Recruit Training 
Command, Orlando. The recruits were in advanced Basic Training and were 
about to enter Apprentice Training. 

The test was given without prior warning to small groups of approximately 
40 recruits as part of a general briefing and took 50 minutes to complete. 

NAVY NUMERICAL SKILLS TEST. *^ 

\ 

♦ The Navy Numerical Skil«;ls Test contains 50 items that are correlated 
with the topics and skills a^idressed in the remedial werkbook, Improving Your 
Navy Numerical Skills . TAEG Report No. 96 provides a detailed descriptiorToT 
the workbook and test. 

Two forms of the test, A and B, are available. In both forms, items .1, 
through 24 in part I of the test assess basic numerical operations of addition, 
subtraction, 'multiplication, and division. .Items 25 through 5Q in part ll 
are word problems which test proficiency in applying the operations to job 
situations in the Navy and financial responsibilities faced in the Navy. 
Form A was used in the present study. ' ■ y t 

A. test score greater than 79 percent 'is recomended as a parsing score. « 
PREDICTIVE DATA ' 

each recruit, s^dent records were analyzed to obtain Reading Grade 
5L) based on the Gates-MacGinitie Reading Test» Survey'D (Gates -And 
ilacGiitiitie, 1965), and scores on four -subtests of the ASVAB. Scores obtained 
were fKom the Arithmetic Reasoning (AR), Paragraph Comprehension .(PC) , Word 
Knowledge (WK), and Numerical Operations (NO) sub tests- (those thought to be 
related to numerical skills). • ' / 

. • > 

Of the total sample, 213 recruits had ASVAB scores based on Forms 5,6, 
and 7, while the remaining 8U .recruits--68 males and 12 females— had ASV'AB" 
scopes based on a newer version— Fonns-8, 9, and 10. The old and new forms 
are comparable except that Patagraph Comprehension is a subtest of only the 
newer forms of, the ASVAB; therefore, only 80 recruits had PC scores 

/ ^ ' i ' 

Selected ASVAB and RGL scores obtained from student records were correlated 
with scqres On the Navy Numerical Skills Test, From the sample of 80 recruits 
administered the new ASVAB, test scores were entered into a multiple regression 
artaly^s to assess the usefulness^f tijose measures as predictors of numerical 
skillT performance. • v 

RESULTS ■ ' ' ' 

»• ' . ' 

\DESCRIPTIVE DATA-TOTAL SAMPLE. Based oh ASVAB test scores and RGLs the 

sample o.f 293 recruits who were administered the Navy Numerical \Ski lis Tes*t 

• ' • ■ ■ ? . " ' ^ 

. ' . ll ^ 
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are representative of the population of Navy recruits who enter Apprentice 
Training, Data collected from stutfent records Itable 1) revealed the expected 

lowered mean scores when compared to a recent 'Navy\ summary report. 3 

* * >■ 



* TABLE 1. SUMMARY OF DATA OF TOTAL SAMPLE OF RECRUITS (N=293) 
\. ON THE nAVy NUMERICAL SKILLS TEST, ASVAB SUBTESTS, 
AND READING <5RADE LEVEL (RGL) 



* * 


' ME^ 




STANDARD 
DEVIATION 


• ■ Percent Scores- Raw 


Scores 


* • 


Mavy Numerical Skills Test 
- Par/ r 

' Paft II *' • , 


94.2 
51.5 

1 


22.6 
13.4 « 


* * 

' 2.1 
4.6 


^ TotaV 




36.0 


11.5* 


Vasvab ^ -"^^ 


9 

Standard Scores 


7.6 
6.5 , 
6.5 ■ 
• 8.1 


Arithmetic Reasoning (AR) 
Paragraph Comprehension /PC)**- 
Word Knowledge (WK) ' 
N'umerical Operations (NO) 


4876 . " 
52.2 
49.7 " 
51.1 

* 


/ 


Reading Gcade Level (RGL) 


9.5 




2.0 











*Based on percent spofes . , , , 

**Data obtairied from 80 recruits who bad been administered the new forms of ^ 
the ASVAB— Forms 8, 9, and 10 * 4 



The mean RGL was 9*5 and, as, expected* ^he mean standard scores on the 
ASVAB sul^tests were slightly below the Navy medians fov* all recruits • On 
Arithmetic /Reasoning, the mean was 48,6 compared to the Navy median of 54,6, v 
On Paragraph Comprehension the me^n was 52*2 compared X6 the Nav^ median of 
53.9/ On Word Knowledge the ri)ean was-49.7 compared to the ^avy ijiedian of 
53.2. oA Numerical Ope^ations the mean waS 5L1 compared to the Navy median 
of 53.9. ^ ' 

Table 1 afso shows l!Jie numerical sH^lls performance of the recruits. On 
the 24 items of [>art I, the group's mean was 22.6 which demonstrated high 



Navy medians 'for ASVAB-Tporms 8, 9,^^d 10— were obtained from the CHI 
Recruit Population Analysis Report , February 1981* Produced by Management 
Information and InstVudxl onal Systems Activity. 



Technical Memorandum 81-4 ^. 

' ' . . " I ' ^ 

performance on -basfc numerical operations. On th£ 26 Items of part II, t+ie 
mearv score was 13.4 which reflects a serious deficit in numerical skills 
application . The test results indicate that ftiany recruits do not possess .the 
analytical Skills necessary to solv.e math problems,' The mean score on the 
whole test was 36.0 (72.2 perpen^t) which is barely alpve the criterion score 
of 70 percent. Of the 293 recruits tested, 108 (or 37 percent) failed to' 
achieve a passing'score. 

Correlations of ASVAB scores and RGL with Navy Nwierlcal Skills Test 
scores are shown' in table 2. . ' ' ' W' 

TABLE 2. CORRELATldNS OF NAVY NUMERICAL SKILLS TEST SCORES OF REC,I\UITS ^ . 
y. (N=293) WITH' THEIR ASVAB SCORES AND -RGL* • ' ' ' ■* 



Navy Numerical 
Skills Test 


■» 

ASVAB 


' RGL 




AR • 


PC* 


WK 






Part I . 


.27 


.11 


.10 


.24 


.12 


Part U 


.48 


.31 


.28 


.•46 


• .39 


• Total 


.49 


.45 - 


.26 


.50 ' 


,•32 



administered the new forms of;Uhe ASVAB— Forms 8, 9, and 10 

All Correlations were significant aft the .05 level (r>,19) except for the 
correlations of part I with PC, WK^wrjd RGL (Bruning and Kintz, 1968).. Part, 

I correlates only with the ASVAB tests that measure math skills, while part''. 

II correlate^s with tests that measure verbal skills as well, and also with , 
RGL. The analytical skills needed to solve word nwth problems (as measured 
by part II) are related to.thes^ verbal skills. , * 

For the sample, scores on piarts I and II were correlated significantly 
with each other (r = .34), and both are correlated significantly with tlie , 
total score. For part I and Total, r = .54, and for part H and Tota-l, r = , 
.89. . . * 

MULTIPLE REGRESSION AFjALYS IS --SUES AMPLE. Eighty recruits had ASVAB scores on 
Forms 8, 9> arnd 10--the newest forms of the test battery^ Da^a from this 
subsample were used to assess the usefu^wess of ASVAB scores and RGL as 
predictors of numerical skijls performance- The data shown in table 3 describe 
the subsample* - ^ , 



-erJc 



C 



13 



'I 



Technical Memorandum 81-4 



TABLE 3. SUMMARY OF DATA OF 80 RECRl/lTS ON THE NAVY NUMERICAL SKILLS TEST, 
ASVAB (FORMS 8,- 9, AND 10) SUBTESTS, AND READING GRADE LEVEL (RGL) 



MEAN 



STAtiDARD 
DEVIATION 



/ Percent Scores 

Navy Numerical Skills Test 



Part I 
Part II 



95.4 
53.1 



Raw Scores 



22.9 
13,8 



Total 



73.2 



36.7 



1.5 
M.O 

•9.&' 



ASVAB 



Arithmetic Reasoning (AR) 
Paragraph Comprehension (PC) 
Word Knowledge (WK) 
Numerical Operations (NO) . 

Reading. Grade Level (RGL) 



Standard Scores 

50,5 
52.2 - 
50,4 
51.2 

9.6 



7.0 
6.5 
7.2 
•8.2 

2,0 ) 



•v*Based on percent scores. 

Scores on the, Navy Numerical Skills Test from the subsample were similar 
to those obtained from the whole sample. Thirty percent failed to achieve a 
passing total score. Mean RGL ahd.mean ASVAB scores were close to those of 
the entire sampfle. Correlatl-ons of Navy Numerical Skills Test scores with 
ASVAB scores and RGL are sh'own in table 4. 



TABtE:'4 



CORRELATIONS OF^ 
WITH THEIR ASVAB 




MERICAL SKILLS TEST SCORES OF 80 RECRUITS 
8, 9, And 10) SCORES AND RGL 



Navy Numerical 
Skills Test 




• 

ASVAB 


^ 




* 

RGL 


t 


AR 


• PC ; 




NO 




fart I 


.03 


.11 


.00 


-.01 


-.13 


Part 11 ^ 


.59 


:31 


.13 


.30 


.44 


Total 


*- .57 


.45 


.26 


.38 • 


.38 



t 4 
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To examine the predictive ability of the ASVA8 scores- and RGL, a forward 
stepwise multiple regression analysis^ was performed that first .entered into 
the regression equation that variable which explained the greatest amount of 
varitince in the outcome variable (Navy Numerical Skills Test total percent 
score). The three variables thaf were found to contribute most to the variance 
were Arithmetic R6asoning (AR), Paragraph Comprehension (PC), andNumerical 
Operations (NO). Table 5 shows multiple R's and the cumulative percentage of 
variance explained as each variable was entered into the regression equation. 
A multiple "R value indicates how well numerical skills scores can be predicted 
from an optimal combination of predictors 

The predictor equation t^t accounts tor 48 percent of the variance* is: 

Numerical Skills Test Score (%) » .61 (AR) + .44(PC) + .27(N0) + 5.5. 

This equation can serve to identify recruits who need remedial math training.'' 
It can be used to predict numerical skills performance when ASVAB subtest 
scores are available. / 



TABLE 5. MULTIPLE REGRESSION SUMMARY TABLE BASED ON DATA 
FROM 80 RECRUITS WHO WERE ADMINISTERED ASVAB • 
(FORMS ^ 9, and 10) 



r 


Pjredictor ^ 
Variables 


Multiple 
R 


' ^ Cumulative 
Percentage 
Variance Explained 


f 


AR , 


.57 


32 




AR & PC 


* 

.66 


43 ' 




AR & PC & NO 


:69 


48 



''^This is a conrlonly use<i computerized statistical procedure from Nie, Hull, 
O^ilKiOS, Steinbrenner, and Bent (1975). 
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CONCLUSIONS 



■ SECTION III 
' CONCLUSIONS AND RECPMMENOATIONS 

» 



. The results of th^s study agr^e with rei . .^^ . — 

96. The recruits' mean Navy NumerTcal Skills Test scores, RGL, and ASVAB 
scores were very similar to means obtained from a sample of 25 recruits in 
Apprentice Training who were tested in early 1980 as pari of a field test of 
lithe remedial workbook, fmproving Your Navy Numerical Skills . In the most ^. 
recently tested sample, 37 peijcent'of the recruits failed the Navy Numerical 
Skills Test at'the*70 percent <?^lterion level, and 81 failed at .the 80 percent 
level. These large percerftag^s indicate a pressing need for early assessment 
of math skill deficiencies and incorporation of remedial math instruction 
into training pvograms. . ^ . 

The test results suggest that recruit's bound for Apprentice Training are 
deficient in applying math skills which involve analytical reasoning rather 
than in the basic nujaprical operations of additi^on, subtraction, multipli- 
cation, and div1si6n. ^ , if 

Wfi^n selected ASVAB an(f RGL scores were analyzed, ah effective formula 
iwas obtained to predict numerical skills performance. The ASWAB subtest 
score on Arithmetic fteasoninq (ARj) is the best predictor (accounts for the 
greatest portion of variance), .and both Paragraph Comprehension (PC) aftd 
Numerical Operations (NO) scorers rontfibute significantly to the accuracy of 
the prediction. -/ 

RECOMMENDATIONS ' 

^sed on the . f i ndi ngs of tb^ present 5tudy> tl^e following reconroendations 
are provided to assist in Identifying Navy^recruits who flay need remedial 
math instructiori. The recoimendations are .especially applicable when con- 
cerned with the population of recruits entering Apprertlice Training. Based 
on instructors* reports, the suggestions also have merit when considering 
. those recruits bound fop "A" i5ch(5Dls. 
■ . ■ 4 

1. *The following equatioiK*, derived in this study, should be used to 
assess the basic numerical skills level of recruits: ' 



)rfie with results reported in TAEG Report Np, 



Numerical Sidlls T^st Score (%) »*.61(AR) + .44(PC) + .27(N0) + 5.5. 



ERIC 



If tti? formula yields a score of 70 or less in predicting numerical skills, 
then ^administer the Navy Numerical Skills Test. If t|ie total score on this 
test Is 70 percent or less, fens^der the recruit for remedial numerical skills 
Instruction. 

e • • 

2. The TAEG has been recently tasked by CNET on behalf of the Chief of 
Naval Technfcal Training (CNTECHTRA) to design and Implement a CBIM system to 
tfack ART and jJob-Oriented Basic Sicills (JOBS) students' activtty throughout 
their training. * - ' 
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The proposed CBIM system will have a data base which contains student efvtry 
records, entry level test results, and progress test results. The authors of 
this report recoirmend the math screening .formula as part of the information 
contained In the system. - 4 * * 

* 3. * Revise the Apprentice Training ancl ''A" schools programs to' include^ 
a heavier%mphas1s on numerical skills assessment arid remedial training, but*'' 
only after dding a thorough rteeds analysis to determine the level of numerical 
skills training required. , , • 



4. Incorporate the remedial math workbook. Improving Your Navy Numerical 
Li 1 1 s , into the math curricula of Apprentice Training. ^ The workbooK covers 



n 

Ski" 

mjtenal directly related to application of numerica> operations In t^ie Navy, 
and this study indicates^ this is the area where most remedial training is 
necessary. 



\ 



1 ^ 



'J. 
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